Fatigue and vigilance in medical experts detecting breast cancer.

An abundance of laboratory-based experiments has described a vigilance decrement of reducing accuracy to detect targets with time on task, but there are few real-world studies, none of which have previously controlled the environment to control for bias. We describe accuracy in clinical practice for 360 experts who examined >1 million women's mammograms for signs of cancer, whilst controlling for potential biases. The vigilance decrement pattern was not observed. Instead, test accuracy improved over time, through a reduction in false alarms and an increase in speed, with no significant change in sensitivity. The multiple-decision model explains why experts miss targets in low prevalence settings through a change in decision threshold and search quit threshold and propose it should be adapted to explain these observed patterns of accuracy with time on task. What is typically thought of as standard and robust research findings in controlled laboratory settings may not directly apply to real-world environments and instead large, controlled studies in relevant environments are needed.

Atypia detected during breast screening and subsequent development of cancer: observational analysis of the Sloane atypia prospective cohort in England.

OBJECTIVE: To explore how the number and type of breast cancers developed after screen detected atypia compare with the anticipated 11.3 cancers detected per 1000 women screened within one three year screening round in the United Kingdom. DESIGN: Observational analysis of the Sloane atypia prospective cohort in England. SETTING: Atypia diagnoses through the English NHS breast screening programme reported to the Sloane cohort study. This cohort is linked to the English Cancer Registry and the Mortality and Birth Information System for information on subsequent breast cancer and mortality. PARTICIPANTS: 3238 women diagnosed as having epithelial atypia between 1 April 2003 and 30 June 2018. MAIN OUTCOME MEASURES: Number and type of invasive breast cancers detected at one, three, and six years after atypia diagnosis by atypia type, age, and year of diagnosis. RESULTS: There was a fourfold increase in detection of atypia after the introduction of digital mammography between 2010 (n=119) and 2015 (n=502). During 19 088 person years of follow-up after atypia diagnosis (until December 2018), 141 women developed breast cancer. Cumulative incidence of cancer per 1000 women with atypia was 0.95 (95% confidence interval 0.28 to 2.69), 14.2 (10.3 to 19.1), and 45.0 (36.3 to 55.1) at one, three, and six years after atypia diagnosis, respectively. Women with atypia detected more recently have lower rates of subsequent cancers detected within three years (6.0 invasive cancers per 1000 women (95% confidence interval 3.1 to 10.9) in 2013-18 v 24.3 (13.7 to 40.1) in 2003-07, and 24.6 (14.9 to 38.3) in 2008-12). Grade, size, and nodal involvement of subsequent invasive cancers were similar to those of cancers detected in the general screening population, with equal numbers of ipsilateral and contralateral cancers. CONCLUSIONS: Many atypia could represent risk factors rather than precursors of invasive cancer requiring surgery in the short term. Women with atypia detected more recently have lower rates of subsequent cancers detected, which might be associated with changes to mammography and biopsy techniques identifying forms of atypia that are more likely to represent overdiagnosis. Annual mammography in the short term after atypia diagnosis might not be beneficial. More evidence is needed about longer term risks.

Evidence-informed recommendations on managing breast screening atypia: perspectives from an expert panel consensus meeting reviewing results from the Sloane atypia project.

Evidence-based clinical guidelines are essential to maximize patient benefit and to reduce clinical uncertainty and inconsistency in clinical practice. Gaps in the evidence base can be addressed by data acquired in routine practice. At present, there is no international consensus on management of women diagnosed with atypical lesions in breast screening programmes. Here, we describe how routine NHS breast screening data collected by the Sloane atypia project was used to inform a management pathway that maximizes early detection of cancer and minimizes over-investigation of lesions with uncertain malignant potential. A half-day consensus meeting with 11 clinical experts, 1 representative from Independent Cancer Patients' Voice, 6 representatives from NHS England (NHSE) including from Commissioning, and 2 researchers was held to facilitate discussions of findings from an analysis of the Sloane atypia project. Key considerations of the expert group in terms of the management of women with screen detected atypia were: (1) frequency and purpose of follow-up; (2) communication to patients; (3) generalizability of study results; and (4) workforce challenges. The group concurred that the new evidence does not support annual surveillance mammography for women with atypia, irrespective of type of lesion, or woman's age. Continued data collection is paramount to monitor and audit the change in recommendations.

Development and quality appraisal of a new English breast screening linked data set as part of the age, test threshold, and frequency of mammography screening (ATHENA-M) study.

OBJECTIVES: To build a data set capturing the whole breast cancer screening journey from individual breast cancer screening records to outcomes and assess data quality. METHODS: Routine screening records (invitation, attendance, test results) from all 79 English NHS breast screening centres between January 1, 1988 and March 31, 2018 were linked to cancer registry (cancer characteristics and treatment) and national mortality data. Data quality was assessed using comparability, validity, timeliness, and completeness. RESULTS: Screening records were extracted from 76/79 English breast screening centres, 3/79 were not possible due to software issues. Data linkage was successful from 1997 after introduction of a universal identifier for women (NHS number). Prior to 1997 outcome data are incomplete due to linkage issues, reducing validity. Between January 1, 1997 and March 31, 2018, a total of 11 262 730 women were offered screening of whom 9 371 973 attended at least one appointment, with 139 million person-years of follow-up (a median of 12.4 person years for each woman included) with 73 810 breast cancer deaths and 1 111 139 any-cause deaths. Comparability to reference data sets and internal validity were demonstrated. Data completeness was high for core screening variables (>99%) and main cancer outcomes (>95%). CONCLUSIONS: The ATHENA-M project has created a large high-quality and representative data set of individual women's screening trajectories and outcomes in England from 1997 to 2018, data before 1997 are lower quality. ADVANCES IN KNOWLEDGE: This is the most complete data set of English breast screening records and outcomes constructed to date, which can be used to evaluate and optimize screening.

Comparing outcomes from tailored meta-analysis with outcomes from a setting specific test accuracy study using routine data of faecal calprotectin testing for inflammatory bowel disease.

BACKGROUND: Meta-analyses of test accuracy studies may provide estimates that are highly improbable in clinical practice. Tailored meta-analysis produces plausible estimates for the accuracy of a test within a specific setting by tailoring the selection of included studies compatible with a specific setting using information from the target setting. The aim of this study was to validate the tailored meta-analysis approach by comparing outcomes from tailored meta-analysis with outcomes from a setting specific test accuracy study. METHODS: A retrospective cohort study of primary care electronic health records provided setting-specific data on the test positive rate and disease prevalence. This was used to tailor the study selection from a review of faecal calprotectin testing for inflammatory bowel disease for meta-analysis using the binomial method and the Mahalanobis distance method. Tailored estimates were compared to estimates from a study of test accuracy in primary care using the same routine dataset. RESULTS: Tailoring resulted in the inclusion of 3/14 (binomial method) and 9/14 (Mahalanobis distance method) studies in meta-analysis. Sensitivity and specificity from tailored meta-analysis using the binomial method were 0.87 (95% CI 0.77 to 0.94) and 0.65 (95% CI 0.60 to 0.69) and 0.98 (95% CI 0.83 to 0.999) and 0.68 (95% CI 0.65 to 0.71), respectively using the Mahalanobis distance method. The corresponding estimates for the conventional meta-analysis were 0.94 (95% CI 0.90 to 0.97) and 0.67 (95% CI 0.57 to 0.76) and for the FC test accuracy study of primary care data 0.93 (95%CI 0.89 to 0.96) and 0.61 (95% CI 0.6 to 0.63) to detect IBD at a threshold of 50 µg/g. Although the binomial method produced a plausible estimate, the tailored estimates of sensitivity and specificity were not closer to the primary study estimates than the estimates from conventional meta-analysis including all 14 studies. CONCLUSIONS: Tailored meta-analysis does not always produce estimates of sensitivity and specificity that lie closer to the estimates derived from a primary study in the setting in question. Potentially, tailored meta-analysis may be improved using a constrained model approach and this requires further investigation.

Breast screening atypia and subsequent development of cancer: protocol for an observational analysis of the Sloane database in England (Sloane atypia cohort study).

INTRODUCTION: The National Health Service (NHS) Breast Screening Programme aims to detect cancer earlier when treatment is more effective but can harm women by over diagnosing and overtreating cancers which would never have become symptomatic. As well as breast cancer, a spectrum of atypical epithelial proliferations (atypia) can also be detected as part of screening. This spectrum of changes, while not cancer, may mean that a woman is more likely to develop breast cancer in the future. Follow-up of atypia is not evidence based. We currently do not know which atypia should be detected to avoid future cancer. This study will explore how atypia develops into breast cancer in terms of number of women, time of cancer development, cancer type and severity, and whether this varies for different types of atypia. METHODS AND ANALYSIS: The Sloane cohort study began in April 2003 with ongoing data collection including atypia diagnosed through screening at screening units in the UK. The database for England has 3645 cases (24 September 2020) of epithelial atypia, with follow-up from 1 to 15 years. The outcomes include subsequent invasive breast cancer and the nature of subsequent cancer. Descriptive statistics will be produced. The observed rates of breast cancer at 1, 3 and 6 years for types of atypia will be reported with CIs, to enable comparison to women in the general population. Time to event methods will be used to describe the time to breast cancer diagnosis for the types of atypia, including flexible parametric modelling if appropriate. Patient representatives from Independent Cancer Patients' Voice are included at every stage of the research. ETHICS AND DISSEMINATION: The study has received research ethics approval from the University of Warwick Biomedical and Scientific Research Ethics Committee (BSREC 10/20-21, 8 October 2020), Public Health England office for data release approvals (ODR1718_313) and approval from the English Breast Research Advisory Committee (BSPRAC_031). The findings will be disseminated to breast screening clinicians (via journal publication and conference presentation), to the NHS Breast Screening Programme to update their guidelines on how women with atypia should be followed up, and to the general public.

2021 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations: Summary From the Basic Life Support; Advanced Life Support; Neonatal Life Support; Education, Implementation, and Teams; First Aid Task Forces; and the COVID-19 Working Group.

The International Liaison Committee on Resuscitation initiated a continuous review of new, peer-reviewed published cardiopulmonary resuscitation science. This is the fifth annual summary of the International Liaison Committee on Resuscitation International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations; a more comprehensive review was done in 2020. This latest summary addresses the most recently published resuscitation evidence reviewed by International Liaison Committee on Resuscitation task force science experts. Topics covered by systematic reviews in this summary include resuscitation topics of video-based dispatch systems; head-up cardiopulmonary resuscitation; early coronary angiography after return of spontaneous circulation; cardiopulmonary resuscitation in the prone patient; cord management at birth for preterm and term infants; devices for administering positive-pressure ventilation at birth; family presence during neonatal resuscitation; self-directed, digitally based basic life support education and training in adults and children; coronavirus disease 2019 infection risk to rescuers from patients in cardiac arrest; and first aid topics, including cooling with water for thermal burns, oral rehydration for exertional dehydration, pediatric tourniquet use, and methods of tick removal. Members from 6 International Liaison Committee on Resuscitation task forces have assessed, discussed, and debated the quality of the evidence, according to the Grading of Recommendations Assessment, Development, and Evaluation criteria, and their statements include consensus treatment recommendations or good practice statements. Insights into the deliberations of the task forces are provided in Justification and Evidence-to-Decision Framework Highlights sections. In addition, the task forces listed priority knowledge gaps for further research.

2021 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations: Summary From the Basic Life Support; Advanced Life Support; Neonatal Life Support; Education, Implementation, and Teams; First Aid Task Forces; and the COVID-19 Working Group.

The International Liaison Committee on Resuscitation initiated a continuous review of new, peer-reviewed published cardiopulmonary resuscitation science. This is the fifth annual summary of the International Liaison Committee on Resuscitation International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations; a more comprehensive review was done in 2020. This latest summary addresses the most recently published resuscitation evidence reviewed by International Liaison Committee on Resuscitation task force science experts. Topics covered by systematic reviews in this summary include resuscitation topics of video-based dispatch systems; head-up cardiopulmonary resuscitation; early coronary angiography after return of spontaneous circulation; cardiopulmonary resuscitation in the prone patient; cord management at birth for preterm and term infants; devices for administering positive-pressure ventilation at birth; family presence during neonatal resuscitation; self-directed, digitally based basic life support education and training in adults and children; coronavirus disease 2019 infection risk to rescuers from patients in cardiac arrest; and first aid topics, including cooling with water for thermal burns, oral rehydration for exertional dehydration, pediatric tourniquet use, and methods of tick removal. Members from 6 International Liaison Committee on Resuscitation task forces have assessed, discussed, and debated the quality of the evidence, according to the Grading of Recommendations Assessment, Development, and Evaluation criteria, and their statements include consensus treatment recommendations or good practice statements. Insights into the deliberations of the task forces are provided in Justification and Evidence-to-Decision Framework Highlights sections. In addition, the task forces listed priority knowledge gaps for further research.

Faecal calprotectin testing in UK general practice: a retrospective cohort study using The Health Improvement Network database.

BACKGROUND: Faecal calprotectin (FC) testing to detect inflammatory bowel disease (IBD) was recommended for use in UK general practice in 2013. The actual use of FC testing following the national recommendations is unknown. AIM: To characterise the use of FC testing for IBD in UK general practice. DESIGN AND SETTING: A retrospective cohort study of routine electronic patient records from The Health Improvement Network database from UK general practice. METHOD: The study included 6 965 853 adult patients (aged ≥18 years), between 2006 and 2016. FC test uptake, the patients tested, and patient management following testing were characterised. RESULTS: A total of 17 027 patients had 19 840 FC tests recorded. The mean age of tested patients was 44.2 years. The first FC tests were documented in 2009. FC test use was still increasing in 2016. By 2016, 66.8% (n = 493/738) of practices had started FC testing. About one-fifth (20.7%, n = 1253/6051) of tests were carried out in patients aged ≥60 years. Only 7.8% (n = 473/6051) of the FC test records were preceded by symptoms eligible for FC testing. Only 3.1% (n = 1720/55 477) of patients with eligible symptoms have received FC testing since the national recommendations were published. There was only a small number of patients with symptoms, FC test, and a IBD diagnosis. In total, 71.3% (n = 1416/1987) of patients with a positive and 47.7% (n = 1337/2805) with a negative FC test were referred or further investigated. CONCLUSION: Uptake of FC testing in clinical practice has been slow and inconsistent. The indication of non-compliance with national recommendations may suggest that these recommendations lack applicability to the general practice context.

Use of artificial intelligence for image analysis in breast cancer screening programmes: systematic review of test accuracy.

OBJECTIVE: To examine the accuracy of artificial intelligence (AI) for the detection of breast cancer in mammography screening practice. DESIGN: Systematic review of test accuracy studies. DATA SOURCES: Medline, Embase, Web of Science, and Cochrane Database of Systematic Reviews from 1 January 2010 to 17 May 2021. ELIGIBILITY CRITERIA: Studies reporting test accuracy of AI algorithms, alone or in combination with radiologists, to detect cancer in women's digital mammograms in screening practice, or in test sets. Reference standard was biopsy with histology or follow-up (for screen negative women). Outcomes included test accuracy and cancer type detected. STUDY SELECTION AND SYNTHESIS: Two reviewers independently assessed articles for inclusion and assessed the methodological quality of included studies using the QUality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool. A single reviewer extracted data, which were checked by a second reviewer. Narrative data synthesis was performed. RESULTS: Twelve studies totalling 131 822 screened women were included. No prospective studies measuring test accuracy of AI in screening practice were found. Studies were of poor methodological quality. Three retrospective studies compared AI systems with the clinical decisions of the original radiologist, including 79 910 women, of whom 1878 had screen detected cancer or interval cancer within 12 months of screening. Thirty four (94%) of 36 AI systems evaluated in these studies were less accurate than a single radiologist, and all were less accurate than consensus of two or more radiologists. Five smaller studies (1086 women, 520 cancers) at high risk of bias and low generalisability to the clinical context reported that all five evaluated AI systems (as standalone to replace radiologist or as a reader aid) were more accurate than a single radiologist reading a test set in the laboratory. In three studies, AI used for triage screened out 53%, 45%, and 50% of women at low risk but also 10%, 4%, and 0% of cancers detected by radiologists. CONCLUSIONS: Current evidence for AI does not yet allow judgement of its accuracy in breast cancer screening programmes, and it is unclear where on the clinical pathway AI might be of most benefit. AI systems are not sufficiently specific to replace radiologist double reading in screening programmes. Promising results in smaller studies are not replicated in larger studies. Prospective studies are required to measure the effect of AI in clinical practice. Such studies will require clear stopping rules to ensure that AI does not reduce programme specificity. STUDY REGISTRATION: Protocol registered as PROSPERO CRD42020213590.

The incidence and prevalence of inflammatory bowel disease in UK primary care: a retrospective cohort study of the IQVIA Medical Research Database.

BACKGROUND: Our knowledge of the incidence and prevalence of inflammatory bowel disease (IBD) is uncertain. Recent studies reported an increase in prevalence. However, they excluded a high proportion of ambiguous cases from general practice. Estimates are needed to inform health care providers who plan the provision of services for IBD patients. We aimed to estimate the IBD incidence and prevalence in UK general practice. METHODS: We undertook a retrospective cohort study of routine electronic health records from the IQVIA Medical Research Database covering 14 million patients. Adult patients from 2006 to 2016 were included. IBD was defined as an IBD related Read code or record of IBD specific medication. Annual incidence and 12-month period prevalence were calculated. RESULTS: The prevalence of IBD increased between 2006 and 2016 from 106.2 (95% CI 105.2-107.3) to 142.1 (95% CI 140.7-143.5) IBD cases per 10,000 patients which is a 33.8% increase. Incidence varied across the years. The incidence across the full study period was 69.5 (95% CI 68.6-70.4) per 100,000 person years. CONCLUSIONS: In this large study we found higher estimates of IBD incidence and prevalence than previously reported. Estimates are highly dependent on definitions of disease and previously may have been underestimated.

Test accuracy of faecal calprotectin for inflammatory bowel disease in UK primary care: a retrospective cohort study of the IMRD-UK data.

OBJECTIVE: To estimate the test accuracy of faecal calprotectin (FC) for inflammatory bowel disease (IBD) in the primary care setting using routine electronic health records. DESIGN: Retrospective cohort test accuracy study. SETTING: UK primary care. PARTICIPANTS: 5970 patients (≥18 years) without a previous IBD diagnosis and with a first FC test between 1 January 2006 and 31 December 2016. We excluded multiple tests and tests without numeric results in units of µg/g. INTERVENTION: FC testing for the diagnosis of IBD. Disease status was confirmed by a recorded diagnostic code and/or a drug code of an IBD-specific medication at three time points after the FC test date. MAIN OUTCOME MEASURES: Sensitivity, specificity, and positive and negative predictive values for the differential of IBD versus non-IBD and IBD versus irritable bowel syndrome (IBS) at the 50 and 100 µg/g thresholds. RESULTS: 5970 patients met the inclusion criteria and had at least 6 months of follow-up data after FC testing. 1897 had an IBS diagnosis, 208 had an IBD diagnosis, 31 had a colorectal cancer diagnosis, 80 had more than one diagnosis and 3754 had no subsequent diagnosis. Sensitivity, specificity, and positive and negative predictive values were 92.9% (88.6% to 95.6%), 61.5% (60.2% to 62.7%), 8.1% (7.1% to 9.2%) and 99.6% (99.3% to 99.7%), respectively, at the threshold of 50 µg/g. Raising the threshold to 100 µg/g missed less than 7% additional IBD cases. Longer follow-up had no effect on test accuracy. Overall, uncertainty was greater for specificity than sensitivity. General practitioners' (GPs') referral decisions did not follow the anticipated clinical pathways in national guidance. CONCLUSIONS: GPs can be confident in excluding IBD on the basis of a negative FC test in a population with low pretest risk but should interpret a positive test with caution. The applicability of national guidance to general practice needs to be improved.

Information given by websites selling home self-sampling COVID-19 tests: an analysis of accuracy and completeness.

OBJECTIVES: To assess the accuracy and completeness of information provided by websites selling home self-sampling and testing kits for COVID-19. DESIGN: Cross-sectional observational study. SETTING: All websites (n=27) selling direct to user home self-sampling and testing kits for COVID-19 (41 tests) in the UK (39 tests) and USA (two tests) identified by a website search on 23 May 2020. MAIN OUTCOME MEASURES: Thirteen predefined basic information items to communicate to a user, including who should be tested, when and how testing should be done, test accuracy, and interpretation of results. RESULTS: Many websites did not provide the name or manufacturer of the test (32/41; 78%), when to use the test (10/41; 24%), test accuracy (12/41; 29%), and how to interpret results (21/41; 51%). Sensitivity and specificity were the most commonly reported test accuracy measures (either reported for 27/41 [66%] tests): we could only link these figures to manufacturers' documents or publications for four (10%) tests. Predictive values, most relevant to users, were rarely reported (five [12%] tests reported positive predictive values). For molecular virus tests, 9/23 (39%) websites explained that test positives should self-isolate, and 8/23 (35%) explained that test negatives may still have the disease. For antibody tests, 12/18 (67%) websites explained that testing positive does not necessarily infer immunity from future infection. Seven (39%) websites selling antibody tests claimed the test had a CE mark, when they were for a different intended use (venous blood rather than finger-prick samples). CONCLUSIONS: At the point of online purchase of home self-sampling COVID-19 tests, users in the UK are provided with incomplete, and, in some cases, misleading information on test accuracy, intended use, and test interpretation. Best practice guidance for communication about tests to the public should be developed and enforced for online sales of COVID-19 tests.

COVID-19 in cardiac arrest and infection risk to rescuers: A systematic review.

BACKGROUND: There may be a risk of COVID-19 transmission to rescuers delivering treatment for cardiac arrest. The aim of this review was to identify the potential risk of transmission associated with key interventions (chest compressions, defibrillation, cardiopulmonary resuscitation) to inform international treatment recommendations. METHODS: We undertook a systematic review comprising three questions: (1) aerosol generation associated with key interventions; (2) risk of airborne infection transmission associated with key interventions; and (3) the effect of different personal protective equipment strategies. We searched MEDLINE, Embase, Cochrane Central Register of Controlled Trials, and the World Health Organization COVID-19 database on 24th March 2020. Eligibility criteria were developed individually for each question. We assessed risk of bias for individual studies, and used the GRADE process to assess evidence certainty by outcome. RESULTS: We included eleven studies: two cohort studies, one case control study, five case reports, and three manikin randomised controlled trials. We did not find any direct evidence that chest compressions or defibrillation either are or are not associated with aerosol generation or transmission of infection. Data from manikin studies indicates that donning of personal protective equipment delays treatment delivery. Studies provided only indirect evidence, with no study describing patients with COVID-19. Evidence certainty was low or very low for all outcomes. CONCLUSION: It is uncertain whether chest compressions or defibrillation cause aerosol generation or transmission of COVID-19 to rescuers. There is very limited evidence and a rapid need for further studies. Review registration: PROSPERO CRD42020175594.

Algorithm based smartphone apps to assess risk of skin cancer in adults: systematic review of diagnostic accuracy studies.

OBJECTIVE: To examine the validity and findings of studies that examine the accuracy of algorithm based smartphone applications ("apps") to assess risk of skin cancer in suspicious skin lesions. DESIGN: Systematic review of diagnostic accuracy studies. DATA SOURCES: Cochrane Central Register of Controlled Trials, MEDLINE, Embase, CINAHL, CPCI, Zetoc, Science Citation Index, and online trial registers (from database inception to 10 April 2019). ELIGIBILITY CRITERIA FOR SELECTING STUDIES: Studies of any design that evaluated algorithm based smartphone apps to assess images of skin lesions suspicious for skin cancer. Reference standards included histological diagnosis or follow-up, and expert recommendation for further investigation or intervention. Two authors independently extracted data and assessed validity using QUADAS-2 (Quality Assessment of Diagnostic Accuracy Studies 2 tool). Estimates of sensitivity and specificity were reported for each app. RESULTS: Nine studies that evaluated six different identifiable smartphone apps were included. Six verified results by using histology or follow-up (n=725 lesions), and three verified results by using expert recommendations (n=407 lesions). Studies were small and of poor methodological quality, with selective recruitment, high rates of unevaluable images, and differential verification. Lesion selection and image acquisition were performed by clinicians rather than smartphone users. Two CE (Conformit Europenne) marked apps are available for download. SkinScan was evaluated in a single study (n=15, five melanomas) with 0% sensitivity and 100% specificity for the detection of melanoma. SkinVision was evaluated in two studies (n=252, 61 malignant or premalignant lesions) and achieved a sensitivity of 80% (95% confidence interval 63% to 92%) and a specificity of 78% (67% to 87%) for the detection of malignant or premalignant lesions. Accuracy of the SkinVision app verified against expert recommendations was poor (three studies). CONCLUSIONS: Current algorithm based smartphone apps cannot be relied on to detect all cases of melanoma or other skin cancers. Test performance is likely to be poorer than reported here when used in clinically relevant populations and by the intended users of the apps. The current regulatory process for awarding the CE marking for algorithm based apps does not provide adequate protection to the public. SYSTEMATIC REVIEW REGISTRATION: PROSPERO CRD42016033595.

Faecal calprotectin to detect inflammatory bowel disease: a systematic review and exploratory meta-analysis of test accuracy.

OBJECTIVE: Test accuracy of faecal calprotectin (FC) testing in primary care is inconclusive. We aimed to assess the test accuracy of FC testing in primary care and compare it to secondary care estimates for the detection of inflammatory bowel disease (IBD). METHODS: Systematic review and meta-analysis of test accuracy using a bivariate random effects model. We searched MEDLINE, EMBASE, Cochrane Library and Web of Science until 31 May 2017 and included studies from auto alerts up until 31 January 2018. Eligible studies measured FC levels in stool samples to detect IBD in adult patients with chronic (at least 6-8 weeks) abdominal symptoms in primary or secondary care. Risk of bias and applicability were assessed using the Quality Assessment of Diagnostic Accuracy Studies-2 criteria. We followed the protocol registered as PROSPERO CRD 42012003287. RESULTS: 38 out of 2168 studies were eligible including five from primary care. Comparison of test accuracy by setting was precluded by extensive heterogeneity. Overall, summary estimates of sensitivity and specificity were not recorded. At a threshold of 50 µg/g, sensitivity from separate meta-analysis of four assay types ranged from 0.85 (95% CI 0.75 to 0.92) to 0.94 (95% CI 0.75 to 0.90) and specificity from 0.67 (95% CI 0.56 to 0.76) to 0.88 (95% CI 0.77 to 0.94). Across three different definitions of disease, sensitivity ranged from 0.80 (95% CI 0.76 to 0.84) to 0.97 (95% CI 0.91 to 0.99) and specificity from 0.67 (95% CI 0.58 to 0.75) to 0.76 (95% CI 0.66 to 0.84). Sensitivity appears to be lower in primary care and is further reduced at a revised threshold of 100 µg/g. CONCLUSIONS: Conclusive estimates of sensitivity and specificity of FC testing in primary care for the detection of IBD are still missing. There is insufficient evidence in the published literature to support the decision to introduce FC testing in primary care. Studies evaluating FC testing in an appropriate primary care setting are needed.

Bacterial Load and Molecular Markers Associated With Early-onset Group B Streptococcus: A Systematic Review and Meta-analysis.

BACKGROUND: The natural history of neonatal group B Streptococcus (GBS) is poorly understood. Little is known about the bacterial factors influencing the transmission of GBS from mother to neonate, or the development of invasive early-onset GBS disease (EOGBS) in colonized neonates. We reviewed whether bacterial load and molecular markers are associated with GBS vertical transmission and progression to EOGBS. METHODS: We searched Medline, Embase, Cochrane and Web of Science from inception to October 10, 2016, for observational studies in English. We also hand-searched reference lists of relevant publications and experts cross-checked included studies. Two reviewers independently screened studies, extracted data and appraised the quality of included studies using the Quality in Prognosis Studies tool. We conducted random-effects meta-analyses where possible and narratively synthesized the evidence in text and tables. RESULTS: Seventeen studies were included from 1107 records retrieved from electronic databases and publication references. Meta-analyses of 3 studies showed that neonates colonized by serotype III had a higher risk of developing EOGBS than serotype Ia (pooled risk ratio: 1.51, 95% confidence interval: 1.12-2.03) and serotype II (risk ratio: 1.95, 95% confidence interval: 1.10-3.45). Eleven studies showed that in heavily colonized mothers, 2-3 times more neonates were colonized, and in heavily colonized neonates, up to 15 times more neonates had EOGBS, compared with light colonization. Most evidence was published before 2000 and was at risk of bias. CONCLUSIONS: Acknowledging the difficulty of natural history studies, well-controlled studies are needed to assess the predictive value of pathogen subtype and heavy load; they may be useful for better-targeted prevention.